http://www.interaction-ipsj.org/proceedings/2016/data/pdf/16INT004.pdf

  • Proposal to solve the problems when performing remote work in a telepresence environment.

    • The viewpoint is very shaky if left as it is -> Use a 360-degree camera.
    • Cannot view from a location other than the local user’s viewpoint.
  • A system that allows switching between three viewpoints: local user ①, local user ②, and third-person viewpoint.

    • The third-person viewpoint is a world created by generating point clouds using the RGB-D (depth) sensor of Kinect.
    • Moving to the third-person viewpoint is defined as Jack Out, and moving to the user viewpoint is defined as Jack In.
    • Smooth transitions between Jack In/Out are achieved through carefully designed animations that convey a sense of detachment and integration.
  • The remote user’s environment is a room with projected viewpoint images on three walls.

    • It is more convenient to use real tools such as physical notes when giving instructions for remote work.
  • Experimental results:

    • Improvements are needed in the transition algorithm.
    • With only a first-person viewpoint, it was necessary to support the direction faced by the local user, but this is not required in the Jack In Space environment.
    • It was found that this concept is effective in a remote work environment.
  • Thoughts:

    • It reminded me of the transition in Google MapsStreet View/3D maps.
    • I was surprised that projectors were used in the remote user’s environment.
      • Nowadays, there might be different technologies like transparent displays.
    • I realized that it’s okay to consider the prototype as a proof of concept.

#reference Log#jackin